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Method and arrangement for implementing convolutional 
decoding 

field of the invention 

The invention relates to a method and an arrangement for decoding 
5 and channel correcting a convolutionally encoded signal in a receiver, by 
means of a feedback neural network, said signal being received over a trans- 
mission path. 

BACKGROUND OF THE INVENTION 

In telecommunication connections, the transmission path used for 
10 transmitting signals is known to cause interference to telecommunication. This 
occurs regardless of the physical form of the transmission path, i.e. whether 
the transmission path is a radio link, an optical fibre or a copper cable. Par- 
ticularly in telecommunications over a radio path there are frequently situations 
where the quality of the transmission path varies from one occasion to another 

1 5 and also during a connection. 

Radio path fading is a typical phenomenon that causes changes in 
a transmission channel. Other simultaneous connections may also cause in- 
terferences and they can vary as a function of time and place. 

In a typical radio telecommunication environment the signals be- 

20 tween a transmitter and a receiver propagate on a plurality of routes. This 
multipath propagation mainly results from signal reflections from surrounding 
surfaces. The signals that propagated via different routes reach the receiver at 
different times due to different transit delays. Various methods have been de- 
veloped in order to compensate the interference caused by this multipath 

25 propagation. 

In order to reduce the effects of interference caused by the trans- 
mission path, a digital signal is encoded so as to make the transmission con- 
nection more reliable. Thus the errors caused by the interference in the trans- 
mitted signal can be detected and, depending on the encoding method used, 

30 also corrected without retransmission. Conventional encoding methods used 
in digital telecommunication include, for instance, block coding and convolu- 
tional coding. In block coding the bits to be encoded are grouped into blocks at 
the end of which are added parity bits, by means of which the correctness of 
the bits of the preceding block can be checked. 

35 in the receiver, the errors caused by multipath propagation are typi- 
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cally first corrected, for instance, by a linear transversal corrector and thereaf- 
ter the convolutional code is decoded. 

The efficiency of convolutional coding depends on the code rate 
and constraint length used. A large constraint length enables good error cor- 
5 rection capability, but on the other hand, decoding by known methods is then 
very complicated. 

In general, convolutional coding is decoded by using a Viterbi algo- 
rithm that has nearly optimal performance. However, the Viterbi algorithm has 
a drawback that its complexity increases exponentially as the constraint length 
1 0 increases. This restricts the constraint lengths available. 

Another known decoding method is sequential decoding that is de- 
scribed in greater detail in Digital Communications, J.G. Proakis, 3rd edition, 
pp. 500-503. One drawback of this algorithm is that the decoding delay does 
not remain constant but varies. 
15 Yet another known decoding method is a so-called stack algorithm 

that is described in greater detail in the above-mentioned publication Digital 
Communications, J.G. Proakis, 3rd edition, pp. 503-506. The performance of 
this algorithm is not so good as that of the Viterbi algorithm. 

Of the known methods, the Viterbi algorithm has the best perform- 
20 ance for decoding the convolutional code, but its implementation has turned 
out to be extremely difficult in practice as the constraint length increases. The 
difficult implementation of the complicated Viterbi algorithm by circuitry has re- 
stricted the constraint lengths available for use. 

A separate channel corrector and decoder are a suboptimal solu- 
25 tion. Use of channel data, in particular within the Viterbi algorithm when com- 
puting the metrics, leads to increased complexity and the implementation of 
practical applications is impossible. 

BRIEF DESCRIPTION OF THE INVENTION 

The object of the invention is to provide a method and an arrange- 

30 ment implementing the method such that the above-mentioned drawbacks can 
be solved. This is achieved by a method of the invention for decoding a con- 
volutionally encoded signal received over a transmission path, which signal 
comprises code words and in which method a transmission channel is esti- 
mated, decoding is carried out by means of an artificial neural network, the 

35 neural network comprising a set of neurons which comprise a set of inputs and 
an output, the received code word set is conducted to the inputs of the neuron, 
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at least some of the inputs of the neuron are multiplied, after multiplication 
some of the inputs of the neuron are combined, some of the output signals of 
the neural network neurons are fed back to the inputs of each neuron, initial 
values of the neurons are set and the network is allowed to stabilize. 
5 Further, in the method of the invention the multiplication of the neu- 

ron inputs depends on the convolutional code used in signal encoding and on 
the estimated channel and on the fact that an estimate of the decoded and 
channel-corrected symbol is conducted from the output signal of a predeter- 
mined neuron to the output of the network after the network has reached a 

10 stabilized state, the set of code words in the shift register is updated and the 
above-described four last steps are repeated until the desired number of code 
words are decoded. 

The invention also relates to an arrangement for decoding and 
channel correcting a convolutionally encoded signal received over a transmis- 

15 sion path, the signal comprising code words and the arrangement comprising 
a neural network which comprises a set of neurons which comprise a set of in- 
puts and an output, the received code words being applied to the inputs of 
said neurons and to at least some of the output signals of the neural network 
neurons, the neurons comprising means for multiplying at least some of the 

20 inputs of the neuron prior to combining means, the arrangement comprising 
means for estimating the transmission channel. Further in the arrangement of 
the invention, estimated channel data is applied to the inputs of the neurons, 
and a predetermined neuron is arranged to give an estimate of the channel- 
corrected and decoded symbol in its output signal. 

25 The preferred embodiments of the invention are disclosed in the 

dependent claims. 

In the solution of the invention, convolutional code decoding and 
channel correction are performed by means of a feedback neural network. 
Several advantages are achieved with the solution of the invention. Perform- 

30 ance that is close to that of the Viterbi algorithm is achieved with the solution 
of the invention by means of considerably simpler circuitry. In the solution of 
the invention, equally complicated circuitry permits a larger constraint length 
and thus improved error correction over the Viterbi algorithm. 

The neural network of the invention can be readily constructed by 

35 semiconductor technology, since the neurons of the neural network are very 
similar to one another in structure, only the input couplings vary. Conse- 



WO 00/72449 PCT/FI00/00457 



4 

quently, to design and implement even a large network does not involve a 
great amount of work. The solution can also be advantageously implemented 
as a VLSI circuit, which makes it fast. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 In the following the invention will be described in greater detail in 

connection with preferred embodiments with reference to the accompanying 
drawings, wherein 

Figure 1 illustrates an example of a telecommunications system 
where the solution of the invention can be applied, 
10 Figure 2 shows an example of a neuron designed by means of the 

method of the invention, 

Figure 3 shows an example of couplings of the neural network neu- 
ron designed by means of the method of the invention, 

Figure 4 illustrates an example of the implementation of the neural 
1 5 network neuron of the invention, 

Figures 5a and 5b illustrate an implementation example of a neural 

network of the invention, 

Figure 6 illustrates an example where decoding is performed by 
means of a plurality of parallel neural networks. 

20 DETAILED DESCRIPTION OF THE INVENTION 

The solution of the invention can be applied in any digital data 
transmission system where a signal to be transmitted is encoded by convolu- 
tional coding. Examples of possible systems include cellular radio systems, 
radio links, wired networks or optical networks. 

25 Figure 1 illustrates an example of a telecommunications system ac- 

cording to the invention. The figure shows a transmitter 100, a signal trans- 
mission path 102 and a receiver 104. The operations of the invention are im- 
plemented in the receiver. The signal transmission path can be a radio path, a 
copper cable or an optical fibre, for instance. 

30 In the transmitter, a data source 106 generates a signal 108 com- 

posed of bits. An error correcting code can be added to the data source signal 
108 by a known FEC (Forward Error Correcting) method, if necessary. This is 
not shown in the figure. The signal 108 is applied to an encoder 110 where 
convolutional coding is effected with desired parameters (constraint length and 

35 code rate). The encoder can have a prior art structure. The encoded signal 
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can be understood as code words whose length depends on the code used. 
The encoded signal is applied to a modulator 112 where the desired modula- 
tion is performed. The modulated signal is further applied to output stages 114 
and a channel adapter 116 of the transmitter which are system-dependent 
5 components. The output stage 114 can be a radio frequency amplifier and a 
filter, for instance. The channel adapter 116 can be an antenna or an electri- 
cal/opto-converter, for instance. 

A transmitter output signal 118 propagates through the transmission 
path 102, i.e. the channel, to the receiver 104. The receiver comprises a 

10 channel adapter 120 and a receiver pre-stage 122 which are system- 
dependent components. The output stage 122 can comprise a radio frequency 
amplifier and a filter, for instance. The channel adapter 120 can comprise an 
antenna or an opto/electrical converter, for instance. The signal is applied from 
the pre-stage 122 further to a channel estimator 123 where channel estimation 

15 is performed by using known methods. From the channel estimator, the signal 
is applied to a demodulator 124 from which is typically received a baseband bit 
stream 126 which can be complex and comprise separate I- and Q-branch 
bits. Timing information is derived from the received signal in a regenerator 
128 by a known method. This timing information is used in demodulation. The 

20 receiver further comprises a control unit 130 which can be advantageously im- 
plemented by a processor. The control unit 130 controls the operation of the 
receiver. Information on the timing is also applied to the control unit. 

The signal 126 coming from the demodulator 124 thus comprises 
the demodulated bits which can be presented as code words. The code words 

25 are applied to a decoder 132 which is implemented by a neural network in the 
receiver of the invention. Convolutional coding is decoded in the decoder and 
the decoder output signal 134 corresponds to the original signal 108. In con- 
nection with convolutional coding, the channel data obtained from the channel 
estimator 123 is taken into account, i.e. channel correction is performed. If an 

30 error correcting code was used in the transmitter, it is decoded at this stage. 
This is not shown in the figure. 

The method for decoding the convolutional code and performing the 
channel correction in accordance with the invention is studied next in greater 
detail. It is assumed in this example that 4 QAM modulation is used. Gener- 

35 ally, the aim of the decoding is to find a bit sequence B that minimizes the 
function 
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rom£\r{t + sdt)-hr e (B(t + sdt)) || 2 =: nun f(B) (1) 

^ 5=0 



where r ff+sdfj is a received code word at a time instant t+sdt, 
dt is a symbol interval, 

h = [h lf h 2 ] are channel coefficients of a two-path channel, 
y c (B(t+sdt)) = [y(B(t+sdt)), y(B(t+(s-1)dt)) a vector with a current 
code word and a preceding code word as components. When 4 
QAM modulation is used, these are complex values. 



10 For the sake of clarity, r (s) = r(t+sdt) and B(s) = B(t+sdt) are used. 

Furthermore, instead of bit values 0 and 1, values -1 and 1 are used. In For- 
mula (1) 

B(s) = [b(s-L+1) b(s)l be{1-,1l 

b(-L + 1),...,b(0) are fixed, L is the constraint length and T is the decoding de- 
15 lay. The encoder function y corresponds to the generation matrix G of a con- 
volutional encoder. On the transmission path, interference, such as noise, ap- 
pears in the signal. A noisy code word received at a time instant s is indicated 
by r(s). It is assumed that the noise is white Gaussian noise. 

Let us study here the generation of a neural network of the inven- 
20 tion by means of an example employing a convolutional code with code rate Vz 
and constraint length L = 3. The generation matrix G for such a code is 

1 0 1 



1 1 1 



The encoder for the convolutional code with code rate !4 and con- 
25 straint length L can be written as a complex function 

y( e(s)) = Yl (B(s)) + /y 2 (S(s)), 

where 



Yi(e(s))=n^ + l-0 gy; H)H) 



i=] 



and g jri s are the elements of the matrix G. Now, as in this example L = 3, the 
30 encoder is of the form 

y( B(s) ) = -b(s) b(s-2) + i b(s)b(s^)b(s-2) 
and the received noisy complex code word is r{s) = r T (s) + / r 2 (s). 

Equation (1) is written out as: 
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Z (r[«(r(j)) 2 +im(r(5)) 2 ] 

+ [^(5)^)6(5)6(5 - 2) - im(r( s)h, c )b(s)b(s - 1)6(5 - 2)] 



+ 



[re(r(s)h;)b(s - 1)6(5 - 3) - im(r(s)%)b(s - 1)6(5 - 2)6(5 - 3)] 
^/if/j, [6( 5) 2 6( s - 2) 2 + 6(5) 2 6( s - 1) 2 6(5 - 2) 2 ] 



+ 2 

+ j Aft [6( j - 1) 2 6( j - 3) J + 6( s - 1) 2 6(5 - 2) 2 b(s - 3) 2 ] 

+ re(h*h, )b(s)b(s - 1)6(5 - 2)6(5 - 3) - im( hfc )b(s)b(s - 1)6(5 - 2)6(5 - 3) 
+ \m{h\K )6(5)6(5 - 1)6(5 - 2) 2 6(5 - 3) + reihfc )b(s)b(s - 1) 2 6(5 - 2) 2 6(5 - 

In the above, the superscript c refers to a complex conjugate. As b(s-1) 2 = 1 
and b(s-2) 2 = 1, the minima of the above function (2) and the function 

5 f{B):= = (3) 

Z (^h(r(5)) 2 +/m(r(5)) 2 ] 

+ [re(r(5)/i, c )6(5)6(5 - 2) - im(r(s)h^)b(s)b(s - 1)6(5 - 2)] 

+ [re(r (5)^)6(5 - 1)6(5- 3) -^(5)^)6(5- 1)6(5-2)6(5- 3)] 

+ j Aft [6(5) 2 6(5 - 2) 2 + 6(5) 2 6(5 - 1) 2 6(5 - 2) 2 ] 

+ \KK [bis - 1) 2 Ks - 3) 2 + 6(5 - 1) 2 6(5 - 2) 2 6(5 - 3) 2 ] 

+ re^h, )b(s)b(s - 1)6(5 - 2)6(5 - 3) - rm(Aft )b(s)b(s - 1)6(5 - 2)6(5 - 3) 
+ //n(Aft )6(5)6(5 - 1)6(5 - 3) + re(Aft )b(s)b(s - 3)). 
are the same. The differences between the functions are in the two last terms. 
To eliminate complicated feedbacks, the function (3) will be employed. 

(3) is differentiated with respect to b(k). Then we obtain a partial de- 
1 0 rivative which is of the form 



db{k) 



I 

i 



1 
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re(r(k)h^)b(k - 2) - im(r(k)hf)b(k - \)b(k - 2) 

- im(r(k + \)hf)b(k + l)b(k - 1) + re(r(k + l)%)b(k - 2) 

- «n(r(Jt + \)%)b(k - l)b(k - 2) + re(r(k + 2)/t, f )b(k + 2) 

- im(r(k + 2)%)b(k + 2)b(k + 1) - /m(r(* + 2)% )b(k + \)b(k - 1) 

+ re(r(* + 3)Jf )6(Jfc + 2) - im(r(k + 3)%)b(k + 2)b(k + 1) + re(/r, e A, )b{k - 3) 
+re(A, e A 2 - 2)b(k - l)b(k - 3) - imft^ )b(k - 2)b{k - 3) 
+ imffihi )b{k - l)b(k - 3) + r«(Af A, )b(k + \)b(k - l)b(k - 2) 
+ imih^ )b(k + \)b(k - 2) + reQifc )b(k + 2)b(k + \)b(k - 1) 

- im(h,% )b(k + 2)b(k - 1) + retf^ )b(k + 3)b(k + 2)b(k + \) 

- imfthz )b(k + 3)b(k + 1) + imihfc )b(k + 3)b(k + 2) + retfh, )b(k + 3) 
+ 5(/i i c /j 1 +%h,)b(k). 



Now we use a gradient method 

bW=bW ~ a -m) 

5 By selecting 

1 

a = 50ft 



it is possible to eliminate the feedbacks appearing in the last term of Formula 
(4). Further by assuming that b(k) obtains values -1 or 1, the following equiva- 
10 lence is true for all the values k = 0.....T 

b(k) = sign( 

- re(r(k)h;)b(k - 2) + im(r(k)h^)b(k - l)b(k - 2) 

+ im(r(k + l)/j, e )b(k + \)b(k - 1) - re(r(k + 1)% )b(k - 2) 

+ im{r{k + \)h^)b{k - \)b(k - 2) - re(r(k + 2)hf)b(k + 2) 

+ im(r(k + 2)h{)b{k + 2)b(k + 1) + im(r(k + 2)%)b(k + l)b(k - 1) 

- re{r(k + 3)h^ )b(k + 2) + im(r(k + 3)h c 2 )b(k + 2)b(k + 1) - re(h c x ^ )b{k - 3) (5) 

- re(/?ft )b(k - 2)b(k - l)b(k - 3) + /m(/ift )b(k - 2)b(k - 3) 

- imQilh, )b(k - l)b(k - 3) - re(fcft )b(k + l)b(k - \)b(k - 2) 

- //M(Aft )b(k + \)b(k - 2) - re(Aft )b{k + 2)b(k + \)b(k - 1) 
+ imift /jj )b(k + 2)b(k - 1) - reihfc )b(k + 3)b(k + 2)b(k + 1) 

+ imih'Kt )b(k + 3)b(k + 1) - ijiKAft + 3)b(k + 2) - reC/i,^ + 3) ). 
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From the above the following updating rule is obtained: one k at a 
time is selected and a corresponding bit is updated by using Formula (5) and 
this is repeated until no changes occur in the bits, i.e. the network is stabilized. 
It should be noted that if k = 7-1 , or k = 7, then 6(7+1) = 0 and 6(7+2) = 0 are 
5 set. In the actual implementation, the operation may take place in parallel such 
that all neurons k are updated simultaneously. 

The iteration according to Formula (5) can thus be presented as an 
artificial neuron of the neural network. By setting S k = b(k), where S k is the 
state of the /c* h neuron and when re and im are the real and imaginary parts of 
10 the external inputs coming to the neuron, the state of the /c* neuron can be 

presented as: 

S k = L(~re(r(k)h!)S k _ 2 ^im(r(k)^)S k ^S k , 2 

+ im{r{k + l)h°)S M S k _ x - re(r(k + 1)^)^-2 
+ im(r(k + A- 2 - re(r(k + 2)%)S k+2 

+ im(r(k+2)h°)S M S M + im(r(k+2)hZ)S M S k _ l 

- re(r(k + 3)%)S M + im(r(k + 3)%)S k+2 S k + -te^h, )S k _ 3 

- reihlh, )S k . 2 S k _ i S k _, + imfflht )S k _ 2 S k _, 

- imihfo )5 A _ 1 5 Jt . 3 - re^h, )S k , } S k , ] S k _ 2 

- imWh, )S M S k _ 2 - reQilh, )S k+2 S M S k _ x 
+ imfflhi )S k+2 S k _ ] - reQifo )S k+3 S M S k+l 

+ iw (Afa )S M S M - imihfo )S M S M - re(h^ )S k+ , ), 

where f a is an activation function, typically a sigmoidal function or a hard iim- 
iter. In Formula (5) a signum function f a {x) = sign(x) is used. 

15 Figure 2 illustrates a neuron according to Formula (6). The state S k 

of the neuron appears at the neuron output. According to Formula (6), real and 
imaginary parts of the products of the received corrupted code words r(t) and 
channel coefficients h 1 and h 2 (or their conjugates) as well as real and imagi- 
nary parts of the products of channel coefficients h 1 and h 2 (or their conju- 

20 gates) are applied to the neuron as an input 200. Since the code rate of the 
code used was 14, one bit to be encoded results in two bits when encoded. 
Correspondingly, in decoding one decoded bit represents two bits of the code 
word. Furthermore, feedback outputs of other neural network neurons, i.e. S k _ 
3 ,S k . 2 , S*_„ S* + , , S k+2 , and S Mt are applied to the neuron as an input 202. The 

25 output of each neuron thus comprises one decoded bit. 

In a preferred embodiment of the invention, the neuron is not fed 
back to itself, i.e. the value S k is not applied to the neuron as an input. The in- 
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puts of the neuron are multiplied according to Formula (6). This is illustrated by 
dots at the intersection of the lines. White dots denote the multiplication of the 
inputs and black dots denote the multiplication of the inputs and the change of 
the sign of the product. The multiplied signals are summed 204 and applied to 
5 an activation function 206 whose output S k 208 is the output value of the neu- 
ron. 

The activation function employed can be either a hard-decision or a 
soft-decision function or a step function. If the result is a hard decision, the 
neuron outputs can have values -1 or 1. If the result is a soft decision, the neu- 

10 ron output can be a floating point number. Correspondingly, if the demodulator 
124 produces soft bit decisions, neuron input 200 comprises floating point 
numbers, and if the demodulator produces hard bit decisions, the neuron input 
200 comprises bits. If both of the neuron inputs comprise bits, the multiplica- 
tion between the inputs can be implemented in a simple manner by digital 

15 technology. 

Since the derived neural network is a so-called optimizing neural 
network, it may be caught in a local minimum. To avoid this, in one preferred 
embodiment of the invention, noise (AWGN) whose variance reduces during 
the stabilization stage is added to the incoming signal in the neurons. In that 
20 case, Formula (6) is of the form 

S k =f a (-re(r(k)ht)S k _ 2 + /m(r(*W)S*_ 1 S Jt _ 2 

+ im(r(k + -re(r{k + \)h c 2 )S k _ 2 

+ im(r(k + \)%)S k _ x S k _ 2 - re(r (k + 2)h c x )S M 

+ im{r(k + 2)h' x )S M S M +im(r(k + 2)h c 2 )S k+] S k . x 

- re(r(k + 3)h c 2 )S k+2 + im(r(k + 3)%)S M S k . -re(h c x h 2 )S k _, 

- re{h\h 2 )S k _ 2 S k _ x S k _ 3 + im{h, c h 2 )S k _ 2 S k _ 3 

-im(h ] c h 2 )S k . i S k , 3 -re(h ] c h 2 )S M S k _ } S k _ 2 

-imWK )S k+l S k , 2 -re(h!h 2 )S k+2 S k+x S k , } 

+ im(h l 'h 2 )S k+2 S k _ ] -re(h } c h 2 )S k 

+ im(h;h 2 )S M S k+] -im(h!h 2 )S k+3 S k+2 -re(h c x h 2 )S M +AWGN). 

In decoding, the following steps are generally carried out for each 
received code word: 

25 1. Setting S_ t . S_ 2 and according to previous decisions. The products of the 
real and imaginary parts of the products of the received code words 
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r(0 r(t+Tdf) and the channel coefficients are applied to the neuron inputs 

200. 

2. Initializing S(/), / = 0,...,T. 

3. Updating the neuron k for each k = 0,...,! according to Formula (7). 

5 4. Reducing the variance of the added noise. If the necessary number of itera- 
tion rounds have been carried out, the procedure is terminated, otherwise the 
procedure returns to step 3. 

After this, the bit to be decoded is at the output of neuron 0. 

Figure 3 illustrates couplings of the neural network designed for de- 

10 coding code rate V2 and constraint length 3. The demodulated code words 322 
and the channel data 324 received from the channel estimation means are 
applied to a single neuron 306 as an input. The code words and the channel 
data are multiplied according to Formula (6) in a multiplier 326. Further, out- 
puts 328, 330 from the adjacent neurons 300 to 304, 308 to 320 are applied to 

15 the neuron 306 as an input. The neuron output is the value of the activation 
function 326, the value being a decoded symbol. The neural network is initial- 
ized such that the previously made bit decisions become the states of the neu- 
rons -3, -2 and -1, i.e. 300 to 304. As the states of the neurons 0.....T, i.e. 306 
to 320, +1 or -1 are set randomly. Thereafter, the network is allowed to stabi- 

20 lize. The decoded bit is the output of the neuron 306, i.e. neuron 0, or if more 

than one bit is decoded at a time, the outputs of the neurons 0 N. 

Duration of the network stabilization can be determined either by 
allowing the iterations to continue until the bit at the output does not vary or by 
performing a predetermined number of iteration rounds. 

25 In order to avoid being caught in a local minimum, other methods 

together with or instead of noise addition can also be used. The number of it- 
eration rounds to be performed can be increased. Another option is to use 
several parallel neural networks. When each neural network is stabilized, the 
best bit decision can be selected from the outputs of the networks. The selec- 

30 tion can be made by a majority decision, for instance, selecting the bit decision 
that occurs most frequently at the outputs of the parallel neural networks. It is 
also possible to re-encode the decoding result and compare the obtained re- 
sult with the received code word, i.e. to select a result that minimizes the func- 
tion 

35 ^t\\^)-r n (s)t ■ (8) 
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Decoding can also be accelerated such that several bit decisions of 
the adjacent neurons, i.e. neurons So,...,S N , are extracted simultaneously from 
the neural network. When decoding the subsequent bits, the states of the neu- 
rons S, L+1 S_, have to be initialized to have the preceding values. 

5 The method of the invention can also be applied when the code to 

be decoded is a punctured code. 

The solution of the invention can also be advantageously applied 
such that fast channel estimates are utilized. Each symbol can be expressed 
using symbol-specific channel data, even though the convolutional code ex- 

1 0 tends over a plurality of symbols. 

Let us study next the complexity of the solution of the invention 
mainly from the viewpoint of implementation. When the constraint length L in- 
creases, more neurons are needed in the neural network and the duration of 
stabilization increases, and consequently the number of multiplications in- 

15 creases. It is known that the complexity of a Viterbi decoder increases expo- 
nentially as the constraint length L increases. However, the complexity of the 
decoder implemented by means of the neural network of the invention in- 
creases much more slowly. When the constraint length is L and the number of 
channel taps is H, each neuron of the neural network is coupled to L+H-2 pre- 

20 ceding and L+H-2 subsequent neurons and to L inputs. If it is assumed that 
the decoding delay is 5L, as it generally is, the decoder requires 5L neurons 
and thus the maximum number of connections is in the order of O (H 2 L 2 n), 
where n is the number of generators. 

The number of multiplications to be performed in one neuron de- 

25 pends on the code generator used, but it is < 0(nH 3 + nH 2 L + nHL 2 ). Thus, 
during one iteration round, when each neuron is updated once, the number of 
multiplications to be performed is 0(nLH 3 + nH 2 L 2 + nHL 3 ). This shows how the 
complexity in the solution of the invention increases considerably more slowly 
than in connection with the Viterbi algorithm as L increases. 

30 Figure 4 illustrates the implementation of the neuron of the neural 

network according to the invention. The neuron state at the neuron output is 
S k . Interfered code words to be decoded, typically composed of bits, and 
channel data are applied to the neuron as an input 400. The number of bits in 
each code word depends on the code rate of the code used. Further, feedback 

35 outputs of other neural network neurons are applied to the neuron as an input 
402. In a preferred embodiment of the invention, the neuron does not com- 
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prise feedback to itself, i.e. the value S k is not applied to the neuron as an in- 
put, but feedback to itself is possible if necessary. 

The inputs of the neuron are multiplied in a matrix 404. The matrix 
couplings are defined by the convolutional code and channel model used, and 
5 the formula corresponding to the couplings can be derived as illustrated in the 
above examples. The inputs can be multiplied with or without a change of 
sign. The multiplied signals are applied to a summer 406 where they are 
summed and the summed signal is further applied to a calculation means 408 
which calculates the activation function and whose output S k 410 is the output 

10 value of the neuron. The calculation means 408 can be implemented by a gate 
array or a processor and software. 

The function producing either a hard or a soft decision can thus be 
used as the activation function. If the result is a hard decision, the neuron out- 
puts can have values -1 or 1. If the result is a soft decision, the neuron output 

15 can be a floating point number. Correspondingly, if the demodulator of the re- 
ceiver produces soft bit decisions, floating point numbers are at the neuron in- 
put 400, and if the demodulator produces hard bit decisions, bits are at the 
neuron input 400. If both of the neuron inputs comprise bits, the multiplication 
between the inputs can be implemented in a simple manner by digital technol- 

20 ogy. 

In one preferred embodiment of the invention, the neuron com- 
prises a noise generator 412 and the generated noise is applied to a summer 
406 where it is added to a sum signal. Variance of the noise to be generated 
reduces during the stabilization of the neural network, as described above. 
25 The noise can be Gaussian noise or binary noise. The binary noise is easier to 
implement, but on the other hand, a suitable number of Gaussian noise sam- 
ples can be stored in a memory element and this noise can be reused. Noise 
generation can be implemented in manners know to the person skilled in the 
art. 

30 The structure of the decoder of the invention is studied next from 

the viewpoint of implementation. Figure 5a illustrates the structure of the neu- 
ral network of the invention. The neural network comprises a set of neurons 
500 to 510, the implementation of which is described above. Code words 512 
that are applied to a shift register 514 are applied to the neural network as an 

35 input. The latest T + L code words, where T is the decoding delay, are stored 
in the shift register. Upon completing the decoding of a code word, the de- 
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coded code word is deleted from the register, the code words in the register 
are shifted one step forward and a new code word is adopted in the last stor- 
age location 516 of the register. Operationally, the shift register is connected 
to the inputs of the neural network neurons 500 to 510. Channel data 517 from 
5 the channel estimation means is further applied to the neural network as an 
input. The channel data is applied to a buffer memory 518. The neural network 
further comprises a buffer memory 520 whose input comprises the outputs of 
the neurons 500 to 510 and whose buffer memory output is operationally con- 
nected to the inputs 724 of the neural network neurons. The number of the 
10 neurons depends on the characteristics of the convolutional code to be de- 
coded. 

The outputs of the neural network neurons are thus operationally 
connected to the buffer memory 520, from which the outputs are fed back 522 
to the inputs 524 of the neurons. The neuron inputs comprise switching means 

15 524 by which only the necessary code words and feedbacks are applied to 
each neuron, in accordance with a formula (as Formula (7) above) derived on 
the basis of the convolutional code to be decoded and the channel data. The 
switching means 524 can be implemented by means of a switching matrix or a 
discrete logic circuit. The bit to be decoded is obtained from the output of the 

20 calculation means 526 calculating the activation function. The calculation 
means 526 can be implemented by separate logic circuits or a processor and 
software. 

The neural network decoder comprises a control unit 528, to which 
is applied a clock signal 530 as an input from the timing information regen- 

25 erator of the receiver, as is described in connection with Figure 1. The control 
unit takes care of the decoder timing, the control of the network stabilization 
time and controls the operation of decoding. 

Figure 5b illustrates a second preferred embodiment, in which sev- 
eral bit decisions of the adjacent neurons, i.e. neurons k /c+n, are extracted 

30 simultaneously from the neural network. In that case, the equipment com- 
prises a plurality of calculation means 526a, 526b. Also in that case, upon 
completing the decoding of the code words, n decoded code words are de- 
leted from the register, the code words in the shift register 514 are shifted a 
corresponding number n of steps forward and n new code words are adopted 

35 in the register. 
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Figure 6 illustrates yet another embodiment of the invention, in 
which decoding is performed by means of a plurality of parallel neural net- 
works. In that case the code words and the channel data 600 are applied to 
two or more neural networks 602, 604 arranged in parallel. The outputs of the 
5 calculation means 606, 608 of the neural networks are applied to a decision 
unit 610 where the best estimate for a decoded bit is selected from the outputs 
of the parallel neural networks. The decision unit can be advantageously im- 
plemented by means of separate logic circuits or a processor and software. 
The decision on the best estimate can be implemented in a variety of ways. 

10 For instance, from the outputs of the parallel neural networks, it is possible to 
select the value that occurs at most outputs to be a decoded bit. The decoded 
bit can also be re-encoded and from the outputs of the parallel neural net- 
works the value that is found correct by re-encoding is selected to be the de- 
coded bit. For the sake of clarity, re-encoding is not shown in the figure but it 

15 can be implemented in manners known to the person skilled in the art. 

The decoder of the invention can be readily constructed by semi- 
conductor technology, since the neurons of the neural network are very similar 
to one another in structure, only the input couplings vary. Consequently, to de- 
sign and implement even a large network does not involve a great amount of 

20 work. Testing of the completed circuit is also simple to implement. The solution 
can also be advantageously implemented as a VLSI circuit, which makes it 
fast. It should also be noted that even though the structure of the decoder of 
the invention is simple and easy to implement, its performance is close to the 
theoretical maximum. 

25 Even though the invention is described above with reference to the 

example of the accompanying drawings, it is obvious that the invention is not 
restricted thereto, but it can be modified in variety of ways within the scope of 
the inventive idea disclosed in the attached claims. 
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CLAIMS 

1. An arrangement for decoding and channel correcting a convolu- 
tionally encoded signal received over a transmission path, the signal compris- 
ing code words and the arrangement comprising a neural network which com- 

5 prises a set of neurons which comprise a set of inputs and an output, received 
code words (400) and at least some of the output signals of the neural network 
neurons being connected to the inputs of said neurons, the neurons compris- 
ing means (404) for multiplying at least some of the neuron inputs prior to 
combining means (406) and the arrangement comprising means (123) for es- 
10 timating the transmission channel, characterized in that estimated 
channel data (517) is further connected to the inputs of the neurons and that a 
predetermined neuron is arranged to give an estimate of a channel-corrected 
and decoded symbol in its output signal. 

2. An arrangement as claimed in claim 1, characterized in 
15 that the neuron comprises means (404) for multiplying at least some of the 

neuron inputs and for changing the sign of the product prior to the combining 
means (406). 

3. An arrangement as claimed in claim 2, characterized by 
comprising a shift register (514) having the received code words as an input, 

20 and a memory element (518) having the estimated channel data (517) as an 
input, said shift register and memory element being operationally connected to 
the inputs of the neural network neurons, and a buffer memory (520) having 
the outputs of the neurons as an input, the output of said buffer memory being 
operationally connected to the inputs of the neural network neurons. 

25 4. An arrangement as claimed in claim 3, characterized by 

comprising means (128, 528) for conducting the received code word set (512) 
to the shift register (514), the estimated channel data (517) to the memory 
element (518), for setting initial values of the neurons and for conducting the 
estimate of the decoded symbol to the output of the network after the network 

30 has reached a stabilized state, for updating the code word set and the esti- 
mated channel data in the shift register and for repeating the above-described 
operation until the desired number of code words are decoded. 

5. An arrangement as claimed in claim 2, charact riz din 
that the neuron comprises means (412) for adding noise to the result of com- 

35 bination in the combining means. 
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6. An arrangement as claimed in claim ^characterized in 
that the output signal of a plurality of predetermined neurons comprises an es- 
timate of the corresponding number of decoded and channel-corrected sym- 
bols. 

5 7. A method for decoding a convolutionally encoded signal received 

over a transmission path, the signal comprising code words and the method 
comprising the steps of 

estimating a transmission channel, 

performing the decoding by means of an artificial neural network, 
10 the neural network comprising a set of neurons which comprise a set of inputs 
and an output, 

conducting the received code word set (512) to the inputs of the 

neuron, 

multiplying at least some of the inputs of the neuron by one another, 
1 5 combining some of the inputs of the neuron after multiplication, 

feeding some of the output signals (520) of the neural network neu- 
rons back to the inputs of each neuron, 

setting the initial values of the neurons and 

allowing the network to stabilize, 
20 characterized in that further in the method 

the multiplication of the neuron inputs depends on the convolutional 
code used in signal encoding and the estimated channel and that 

the estimate of the decoded and channel-corrected symbol is con- 
ducted from the output signal of a predetermined neuron to the output of the 
25 network after the network has reached the stabilized state, 

the code word set in the shift register is updated 

and the above-described four last steps are repeated until the de- 
sired number of code words are decoded. 

8. A method as claimed in claim 7, characterized in that at 
30 least some of the neuron inputs are multiplied in the neuron and the sign of the 

product is changed prior to the combination. 

9. A method as claimed in claim 7, characterized in that, in 
connection with combining the neuron inputs, noise is added to the outcome of 
the combination. 
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10. A method as claimed in claim 9, charact r i z din that 
noise is added such that the variance of the noise approaches zero as the 
network approaches stabilization. 

1 1 . A method as claimed in claim 7, characterized in that 
5 the network is allowed to stabilize for a predetermined period of time. 

12. A method as claimed in claim 7, characterized in that 
the network is allowed to stabilize until the values of the output signals of the 
neurons do not vary. 

13. A method as claimed in claim 7 or 9, characterized in 
10 that after combining the neuron inputs the signal is applied to an activation 

function, at the output of which the output signal of the neuron is obtained. 

14. A method as claimed in claim 13, characterized in that 
from the combined signal the activation function makes a hard decision. 

15. A method as claimed in claim 13, characterized in that 
1 5 from the combined signal the activation function makes a soft decision. 

16. A method as claimed in claim 13, characterized in that 
the activation function is a step function. 

17. A method as claimed in claim 7, characterized in that 
the received code word set (512) is conducted to the neuron inputs by means 

20 of a shift register (514). 

18. A method as claimed in claim 17, characterized in that 
the estimate of the decoded symbol is conducted from the output signal of a 
plurality of predetermined neurons to the output of the network after the net- 
work has reached the stabilized state and that the code word set in the shift 

25 register is updated with the same predetermined number of code words. 

1 9. A method as claimed in claim 7, characterized in that 
the channel estimate is updated such that an estimate of each symbol is cal- 
culated by using a dedicated channel estimate. 

20. A method as claimed in claim 7, characterized in that 
30 decoding is performed by means of a plurality of parallel neural networks and 

that from the outputs of the parallel neural networks the best estimate is se- 
lected to be a decoded bit. 

21 . A method as claimed in claim 20, characterized in that 
from the outputs of the parallel neural networks the value that occurs in most 

35 outputs is selected to be the decoded bit. 



WO 00/72449 PCT/FI00/00457 



19 

22. A method as claimed in claim 20, characteriz din that 
from the outputs of the parallel neural networks the value that is found correct 
by re-encoding is selected to be the decoded bit. 
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